|
In information theory and signal processing, the Discrete Universal Denoiser (DUDE) is a denoising scheme for recovering sequences over a finite alphabet, which have been corrupted by a discrete memoryless channel. The DUDE was proposed in 2005 by Tsachy Weissman, Erik Ordentlich, Gadiel Seroussi, Sergio Verdú and Marcelo J. Weinberger .〔 T. Weissman, E. Ordentlich, G. Seroussi, S. Verdu ́, and M.J. Weinberger. Universal discrete denoising: Known channel. IEEE Transactions on Information Theory,, 51(1):5–28, 2005. 〕 == Overview == The Discrete Universal Denoiser 〔 (DUDE) is a denoising scheme that estimates an unknown signal over a finite alphabet from a noisy version . While most denoising schemes in the signal processing and statistics literature deal with signals over an infinite alphabet (notably, real-valued signals), the DUDE addresses the finite alphabet case. The noisy version is assumed to be generated by transmitting through a known discrete memoryless channel. For a fixed ''context length'' parameter , the DUDE counts of the occurrences of all the strings of length appearing in . The estimated value is determined based the two-sided length- ''context'' of , taking into account all the other tokens in with the same context, as well as the known channel matrix and the loss function being used. The idea underlying the DUDE is best illustrated when is a realization of a random vector . If the conditional distribution , namely the distribution of the noiseless symbol conditional on its noisy context was available, the optimal estimator would be the Bayes Response to . Fortunately, when the channel matrix is known and non-degenerate, this conditional distribution can be expressed in terms of the conditional distribution , namely the distribution of the noisy symbol conditional on its noisy context. This conditional distribution, in turn, can be estimated from an individual observed noisy signal by virtue of the Law of Large Numbers, provided is ``large enough''. Applying the DUDE scheme with a context length to a sequence of length over a finite alphabet requires operations and space . Under certain assumptions, the DUDE is a universal scheme in the sense of asymptotically performing as well as an optimal denoiser, which has oracle access to the unknown sequence. More specifically, assume that the denoising performance is measured using a given single-character fidelity criterion, and consider the regime where the sequence length tends to infinity and the context length tends to infinity “not too fast”. In the stochastic setting, where a doubly infinite sequence noiseless sequence is a realization of a stationary process , the DUDE asymptotically performs, in expectation, as well as the best denoiser, which has oracle access to the source distribution . In the single-sequence, or “semi-stochastic” setting with a ''fixed'' doubly infinite sequence , the DUDE asymptotically performs as well as the best “sliding window” denoiser, namely any denoiser that determines from the window , which has oracle access to . 抄文引用元・出典: フリー百科事典『 ウィキペディア(Wikipedia)』 ■ウィキペディアで「Discrete Universal Denoiser」の詳細全文を読む スポンサード リンク
|